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th upper-limb impairments, including peo- 
ple with multiple sclerosis, spasticity, cerebral palsy, 
paraplegia, or stroke, depend on a personal a: 
for daily life situations and in the working e 

The robot arm MANUS was designed for 



mation (I AT). I his system offers increased control functionality 
for disabled users. FRIEND consists of an electric wheelchair, 
equipped with the robot arm MANUS. Both devices are con- 
trolled by a computer. 1 he man-machine interface (MM I) 
consists on a flat screen and a speech interface. FRIEND 's 
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technological aids, ■ 
the aids has to be imp 
it should be possible 
stract commands to simplify the use of 
the system. This has been partly real- jQ^ 
ized in the commercially available £ 
HANDY system. The HANDY Sf 
user can choose between five fixed 
actions, such as eating different 
kinds of food from a tray or being 
served a drink. However, the restricted 
flexibility of HANDY is a big disadvantage, 
as a fixed environment is a prerequisite. 

To place the full capacity of technical systems like the robo 
arm MANUS with 6 degrees of freedom (DOF) at the user': 
disposal, a shared control structure is necessary. I.ow-leve 
ind taking advantage of all cognitive abilities of th( 
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Actions, such as gripping an object in an tin- 
pouring a cup with a drink and 
ving it to the disabled user, may be started by simple com- 
inds. The user is still responsible for decisions in situations 
icre errors are possible, such as locating objects or planning 
cquence of preprogrammed actions. 

This article presents the robotic system FRIEND, which 
is developed at the University of Bremen's Institute of Auto- 



evelopment is then presented, as well as research results that 
/ill be integrated soon. After a short explanation of the speech 
interface, the methods developed for semiautonomous con- 
^> trol are described. These are programming by demon- 
i, visual servoing, and configuration planning 
*p based on the method of imaginary links. We also 
^ describe the state of integration and our experi- 
e to date. 

Hardware and Software 

* The robotic system consists of an 
electric wheelchair (Meyra, Ger- 
many), a MANUS robot arm (Ex- 
act Dynamics, Holland), and a Dual 
Pentium PC, which is mounted in a spe- 
cial rigid box behind the wheelchair (Fig. 1 ). The robot arm 
is linked to the PC via a CAN-bus to exchange commands 
and measurement data. I he wheelchair receives commands 
via an RS232 interface. A tray mounted on the left side of the 
wheelchair and a flat LCD display as part of the MM I com- 
plete the design. 

1 o integrate semiautonomous actions, the system includes 
cameras. Currently, a mini camera is mounted on top of the 
gripper. For future applications, a stereo-system will be placed 
behind the user's head. 

Figure 2 shows the current software layout, as well as antic- 
ipated software components. Currently, the speech interface is 
implemented as an MMI [1] , but the system architecture facil- 
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itates the addition of other input elements like chin-control, 
suck-blow-control, and control via eye movements. 

The user commands FRIEND by short naturally spoken 
words, and the MMI transforms them into strings using a 
speech recognition software. If a valid command is given, the 
interpreter actu ates the necessary softw are component to per- 
form the task demanded. Types of commands include direct 
control commands for the arm, the start command for a 
semiautonomous action, and commands to activate a com- 
plete sequence. 

Preprogrammed actions, like pouring, may be generated 
off-line, using either a classical teach-in procedure or by robot 
programming by demonstration (RPD). RPD combines pro- 
grammed movements with scripts that can be parameterized. 
A disadvantage of preprogrammed movements is that no vari- 
ations are admissible. The item (the cup or bottle), it's posi- 
tion, and initial conditions (the fluid level) must not be 
different compared to the programming situation. RPD may 
partially eliminate this disadvantage. 

In an unstructured environment the use of preprogrammed 
actions is unsuitable. Therefore, FRIEND uses a combination 
of control by the user and autonomous control by the system. 
If, for instance, the user w ants something to dunk, he first w ill 
have to move the robot arm close to a bottle using speech com- 
mands like "Arm left" or "Arm up." As soon as the 
hand-mounted camera recognizes the object, the user initiates a 
pick action with the command "Pick!" In the pick action, the 
gripper is moved into an adequate position relative to the bottle 
using visual servoing, and the bottle is gripped automatically. 

An additional complication occurs if a desired object isn't 
located in the robot's workspace. A routine work problem is 




to remove a folder from a shelf. In this case, the wheelchair 
first has to move close to the shelf. When the wheelchair is in a 
suitable position, close enough to the shelf to reach the folder, 
the camera system has to recognize the folder. During this rec- 
ognition process, the user supports the system with verbal 
commands to move the cameras close to the folder. When the 
folder is detected successfully, the command "Dock!" acti- 
vates the docking action. A suitable wheelchair position is de- 
termined with the help of the imaginary links method to solve 
the inverse kinematic problem. In this ease the w heelchair and 
the robot arm form a redundant system with 9 DOF. During 
every robot arm and wheelchair action, an intelligent part of 
the arm controller, the so-called Kinematic Configuration 
Controller (KCC) [2], computes collision-free trajectories 
with additional sensor information. 

Speech Control 

I he speech processing system translates naturally spoken 
w ords into commands. It consist of the following modules: 

* Speech recogni/er: 1 ranslates naturally spoken words 

* Command interpreter: Interprets the strings as machine 
commands. 

The speech recognizer consists of the speech recognition 
software Via Voice Gold (by IBM), which translates naturally 
spoken commands entered via a microphone into specific 
words using predetermined grammar. The recognized words 
are transmitted to the command interpreter, which translates 
the words or text sequences received into system commands. 
For safety reasons, the set of commands is organized into a hi- 
erarchical command tree. To suppress the misinterpretation of 
commands, such as interpreted noise or misspelled words, a 
path in the tree must be completed to cause a system action. 
I his minimizes the possibility of erroneous interpretations. If 
the system is in direct command mode and the command in- 
terpreter doesn't receive a permissible command within a 
fixed period of time, the system automatically returns to a safe 
state. The entire tree and the current state of the command are 
represented graphically on the flat screen, because the user can 
easily recognize the state of the system if it is presented in the 
form of pictograms (Fig. 3). 

If the interpreter receives a permissible word, this word is 
highlighted in the tree with a gray background. In addition, all 
recognized words are shown in the left display box. This 
makes it easy for the user to monitor the system's behavior and 
react quickly if an error occurs. 

Currently, four controlling modes of the robot arm are im- 
plemented. These are 

1. Control world coordinates. 

2. Control joint coordinates. 

3. Control tool coordinates. 

4. Activate action sequences. 

It is possible to switch between different coordinate sys- 
tem- or to activate the semiautonomous actions mode and se- 
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quences via the spoken command "Change Mode." This 
makes the system very flexible. 

Programming Complex Motions 
by Demonstration 

To program new motions, the robotic system is equipped 
with two programming environments. In keyboard mode, the 
robotis programmed in the tradition, il way, available in almost 
all robots. In this mode, with the keyboard point-to-point po- 
sitions on a trajectory are generated that are traced and stored 
in a database. In programming by demonstration mode 



(RPD), the programmer demonstrates the task to be executed 
with his own hand. The motions are measured, recorded, and 
processed so that the robot can reproduce them. Many ap- 
proaches described in the literature [3-5] share a common fea- 
ture: they are designed mainly for simple pick-and-place 
applications like those found in industry, such as loading pal- 
ettes and sorting and feeding parts. Neither the demonstrated 
motion trajectory nor the dynamics of the motion, such as the 
speed or general time response, are considered. But in the field 
of rehabilitation robots like FRIEND, where the tasks are 
much more complicated, this information is of great nnpor- 
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Fig. 2. Architecture of the system FRIEND. 
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Fig. 3. MMI with command tree. 




Fig. 4. The human being as a closed loop. 



tance to enable the robot to execute these tasks correctly. 
Moreover, the methods mentioned don't consider that the 
human operator acts as a part of a closed loop (Fig. 4), acting as 
a sensor, control algorithm, and actuator. The loop is closed 
across the environment [6]. 

This closed loop enables a human being to execute even 
very complex trajectories without difficulty and in spite of 
v.in.ible initi.il conditions, l or example, in the described sce- 
nario "pouring;) gl;iss from ,) bottle." the hum. m continually 
observes the level of the glass and the flow from the bottle vi- 
sually. With this information, he controls the motion of the 
bottle and fills the glass to a constant level with different 
shaped bottles and glasses, independent of the initial levels. To 
achieve similar robustness with a robot, a feedback loop must 
be installed. 

The demonstrated motions are divided into subsequences. 
1 he robot may repeat some as demonstrated, whereas others 
have to be part of the control loop. Additional sensor informa- 
tion is included and the controller will modify the recorded 
trajectory. In the next section we explain this method in detail 
for the "pouring a gl 



Trajectory Generation 

First, the trajectory for the pouring process has to be generated 
(Fig. 5) To detect the motion of the bottle, a 6 DOF position 
sensor attached to the bottle and a transmitter, which repre- 
sents the reference system for the motion detection, is used. 

The programmer grasps an open bottle, places it in a rela- 
tive pose to a glass, starts recording, and demonstrates the 



characteristic motion of this action. During the demonstra- 
tion, the current pose of the bottle relative to the transmitter is 
sampled at regular time intervals. These pose data and the cor- 
responding time represent the motion trajectory and are 
stored in an ordered list. With this detection method it is pos- 
sible to precisely copy the demonstrated motion and its dy- 
namics. 1 he investigation of the pouring process yielded that 
it is sufficient to demonstrate one process, in which a full bot- 
tle is emptied completely. 1 his overall trajectory contains all 
the movements for all initial levels. 

Transformation Relative to a 
Specific Reference System 

1 o enable the robot to repeat the demonstrated task, the data 
recorded relative to the transmitter has first to be transformed 
to another reference system. 1 his might be the robot base, l or 
service-robot applications, however, it is useful to consider 
movements of gripped objects relative to other objects. In our 
example, this may be the movement of the bottleneck relative 
to the glass run. 1 he benefit of this approach is that the dem- 
onstrated motion can be performed relative to the glass rim in 
different places. Moreover, the motion becomes independent 
of the specific features of the objects used during the demon- 
stration, because the object information is shifted into homo- 
geneous transformation matrices. Hence, the motion can 
easily be transferred to different shapes of bottles and glasses. In 
the execution phase the motion of the robot has to be calcu- 
lated from the movement of the bottleneck in relation to the 
glass. In the present implementation of FRIEND, the neces- 
sary object information and the position of the glass relative to 
the robot are assumed to be known. In the future, a stereo 
camera system will be used to measure the distances online. 



Division into Open-Loop and 
Closed-Loop Subsequences 

1 xtrcmclv simplified, the pouring process can be divided into 
three subsequences. These subsequences, sent and executed 
sequentially by the robot, are: 

1. Sensor-observed, open-loop start subsequence: From 
the starting pose, the overall trajectory is followed until flow 
from the bottle starts. 

2. Closed-loop controlled pouring subsequence: As soon as 
liquid flows from the bottle, the glass is filled using a 
closed-loop control. I he automatic controller has to keep the 
flow at a desired rate until the desired level or volume in the 
glass is reached. 

3. Open-loop closing subsequence: When the desired level 
or volume is detected, the robot switches to another demon- 
strated trajectory to avoid dripping. 

To implement these subsequences, the transformed tra- 
jectory is stored in an ordered list and a pointer defines the 
next set point value for the robot. Only in open-loop mode 
may the speed be modified bv changing the sampling tune or 
pointer increment. In closed loop, the speed and trajectory 
are modified by the controller. The controller does not cal- 



culate a new pose but a pointer in the ordered list, which de- 
fines a pose. 

This procedure has been implemented and tested with the 
rehabilitation robot MANUS. The actual level of the fluid in 
the glass is determined with a camera (Fig. 6) and the flow 
from the bottle and the volume in the glass are calculated. The 
controller translates the difference between the desired and the 
computed flow to new offsets m the trajectory list and controls 
the flow in this way. figure 7 shows the volume in the glass, 
the computed flow from the bottle and the control output. 

Robust Positioning of the Gripper 

Grasping an object with a support system like FRIEND in di- 
rect control mode is a time-consuming task for the user, even 
with the speech input device. On the other hand, the imple- 
mentation of a general grasp utility leads to very complex al- 
gorithms. Since the number of frequently handled objects in 
our scenario is limited, a supporting utility that handles most 
of the necessary objects is already very helpful. 

FRIEND uses a grasp utility for known labeled objects. Vi- 
sual servoing with a gnpper-niounted camera is Used in con- 
junction with teaching by showing (TbS). With TbS the 
gripper and the labeled object are placed in the desired relative 
position, the corresponding image is taken, and the desired 
features (as image features we use the centers of gravity of the 
four marker points) are extracted and stored. 

If the same object has to be grasped again, it is necessary to 
return the gripper to the taught grasp position. This can be 
done either manually using basic spoken commands or auto- 
matically using visual servoing with the gripper-mounted 
camera. In the latter case, the user has only to move the grip- 
per into a position where the camera can detect the label on 
the object and to initiate the pick action (Fig. 8, left). To sup- 
port the user, a live camera image is represented on the flat 
screen. With visual servoing, the gripper is moved to the posi- 
tion where the actual image features correspond to the taught 
features (Fig. 8, right). 

The visual servoing controller computes the change in the 
position of the robot by comparing the measured and the de- 
sired linage features and moves the robot to the calculated po- 
sition. In the new position, another image is taken and the 
control algorithm is repeated until the taught relative position 
is reached. The robot is driven in Cartesian space with a 
look-a nd-move strategy. 

A controller suitable in a rehabilitation robotic system must: 

* drive the gripper from any reasonable starting position to 
the gripping positu >n and 

* must ensure that the object marker remains in the image 
during the motion. 

Due to the slow sampling time of the vision system in clut- 
tered environments, a small number of steps are important 
also. In order to compare the behavior of the different auto- 
matic controllers systematically, a computer simulation was 
developed, named multi-position test [7]. 



Traditional Image-Based Automatic Controllers 

The literature usually discusses automatic controllers with a 
linear system model. The image Jacobian is constant or 
adapted by parameter estimation at the operating point. In ev- 
ery sampling step, a robot movement b is computed — using 
the image Jacobian and the current image error — to minimize 
the image error e. Finally the manipulated variable u is com- 
puted using an amplification factor k < 1: 

u = kb (1) 

1 raditionally, such automatic controllers work with a constant 
amplification factor k. But at start up of visual control, when the 
image error is quite large, an automatic controller with a con- 
stant gain would compute a large output. To guarantee safe op- 




Fig. 5. Demonstration. 
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Fig. 6. Pouring a glass: external (top) and camera (bottom) view. 
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Fig. 7. Experimental results. 



eration in the whole workspace in spite of the inaccuracy of a 
linear system model, a small value of k has to be chosen. How- 
ever, this necessitates a high number of sampling steps. 

Trust Region Method-Based Automatic Controllers 

To reduce the number of necessary control steps, we devel- 
oped a controller that limits the model-predicted movement 
of the label in the image according to a constant parameter a. 
This leads to an adapted amplification factor k : 

_ r maximum movement in the image ; 
[ ' model - predicted movement in the image J 

(2) 

With k" , an automatic controller that limits the movement in 
the image at start up is achieved. Close to the target position, 
when the image-based error is small, the limitation becomes 
inactiv e (i.e., A"* = I) and fast convergence is obtained. A value 
ofO.= <U)8 mm, which guarantees convergence in the entire 
workspace, was determined experimentally. The number of 
necessary sampling steps is significantly reduced compared to 
the traditional controllers. 

C. im.iv also be adapted in every control step depending on 
the difference betw een the model and reality by introducing a 
trust region. I he resulting adaptiv e controller improves the 
control result |8|. Jagersand |9| has already applied trust region 
methods for visual servoing applications. I le controlled the 
joint coordinates of the robot and used primarily a stationary 
stereo camera system. Since the 1960s, trust region methods 

tion theory. I hey are also called restricted step methods. 



1 he controller with adapted a has 
been tested with an industrial robot and 
has been implemented in IRIHND re- 
cently. I he approach is calibration-robust 
and hence suitable for the roughly cali- 
brated miniature camera at MANUS | I 0|. 

One of the main problems for visual 
servoing w ith a gripper-mounted camera 
is the variable object si/e resulting from 
camera movement. I his leads to very 
high demands on the object recognition 
algorithms. We developed an approach 
using a zoom camera to obtain constant 
object sizes during movement | I I |. 

Unfortunately, zoom cameras are cur- 
rently too heavy and too bulky to be 
mounted on the MANUS arm, but they 
can be mounted behind the user, with a 
pan-tilt system for visual servoing of the 
robotic arm. For this purpose the method 
of virtual points |I2| has been developed 
at the IAT and will be implemented in 
FRIEND soon. 

(Semi-)Automatic Docking-Action 

Abating the complexity, the wheelchair has to be stationary in 
the room before the grip action is launched. The object to be 
grasped has to be within the working space of the robot. Oth- 
erwise, the wheelchair must be moved closer to the object. 
The location of the wheelchair (i.e., Cartesian position X B and 
Y B on the floor and orientation angle 4^) has to be selected in a 
way that the object is in the workspace of the manipulator and 
can be grasped without colliding with potential obstacles. We 
call this process the "docking action." 

I he obvious strategy of" ''the closer the better" is not al- 
ways correct for a room with obstacles, as illustrated in Fig. 9 
and in I : ig. I 0. When the w heelchair is too close to the object, 
a collision with the shelves results. Choosing a suitable loca- 
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Fig. 8. Start (left) and end (right) of pick action. 



tion in ,1 real environment manually is very arduous, since this 
location cm only he determined during the grasping process, 
l or users w ith limited head mobility, it is almost impossible to 
estimate .1 clustered spatial situation correctly. 

A (semi-),iutonomous docking system assists the user. A 
suitable w heelchair location is calculated from spatial informa- 
tion about the object and obstacles. To recognize the object 
and reconstruct the scene, stereo cameras are needed. 

lo automatically determine a suitable docking location, the 
inverse kinematic problem for the entire robotic system with 9 
DOl has to be solved. I his means, from the kinematic equation, 

ig =/( 3 B )6 A) (3) 

the w heelchair coordinates s B = | X„ Y„ 4^ | 7 and the ma- 
nipulator configurations, ,, A = \A f A h | have to be cal- 
culated, gisan .N-dimensional vector of the desired C 'artesian 
location of the gripper, and the nonlinear vector function f 
specifies the kinematic structure of the robotic system. 

The dimension s of the vector g depends on the object to 
be gripped. When the gripper location is determined com- 
pletely (i.e., both the Cartesian coordinates X T , Y T , Z T of the 
Tool Center Point and the gripper orientation Yaw, Pitch, and 
Roll are unequivocally defined), the vector 
s g = [X T , Y T , Z T , Yaw, Pitch, Roll] has a size s = 6. Grasping 
a book may serve as an example. However, such a fully de- 
fined specification occurs in service robotics only rarely. 
Figure 1 1 shows three typical grasping cases. If a cylinder (e.g., 
a glass or a bottle) must be grasped, the orientation angle Yaw 
is not defined precisely (it can have an arbitrary value between 
0 and ±180°). This leads to s g = [X T , Y T , Z T , Pitch, Roll] 
and 5=5. When grasping a ball-shaped object such as an apple 
or an egg, all three orientation angles are free, 
s g=[X 7 -,Y T ,Z T ]andi = 3. 

This means that equation system (3) is an undcrdetermined 
system with a high degree of redundancy r = 1 0 — 5 > 4. Using 
the conventional method of inverse kinematic analysis for re- 
dundant manipulators, the value-, ol iedlindanl Jij'hv- ot 
freedom have to be specified in addition to the vector g. This 
yields a so-called functional-closed solution, which contains 
joint variables as parameters. To determine a suitable robot 
configuration, all possible combinations of redundant joint 
values have to be considered. For a robotic system with high 
redundancy, as in our ease, this kind of solution has a huge 
computational cost. 

To calculate a suitable robot configuration in strict real 
time, an explicit closed solution of the inverse kinematics 
problem is desirable. This solution can be obtained using the 
method of imaginary links 1 13]. In this approach, the redun- 
dancy problem is solved by complementing equation system 
(3) with the corresponding number r =9 — 5 of additional sca- 
lar equations of the type 

X\ = (R k -R Ak ) T -(R k -R Ak ). (4) 




Fig. 9. Positioning the wheelchair too dose to the object causes a 
collision with the shelf. 




Fig. 10. Grasping without collision from a suitable (optimal) wheel- 
chair location. 



I hese equations define the arrangement of redundant joints in 
C 'artesian space with respect to specific points R . . 

The simple form of these additional equations makes it 
possible to derive a closed analytical solution for robots with 
regular geometry; i.e., those with perpendicular or parallel 




In addition to the desired gripper location g, the extended 
inverse function i e now contains a set of independent parame- 
ters A = {A,.} and 9t = {R A .}. The parameters A,,, can be 
viewed as the lengths of imaginary links with nonactuated 
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spherical joints at either end. These links connect the redun- 
dant joints with virtual anchor points, placed at Cartesian 
points R Aj . By choosing the parameters for the imaginary 
links, information about the free workspace can be introduced 
directly into the solution. The local free space around an arbi- 
trary Cartesian point R can be approximated using elastic 
spheres, called bubbles (lag. 1.2), with variable radii X r When 
X i < X imax , the redundant joints are guaranteed to be in colli- 
sion-free positions. 

Figure 13 shows the corresponding collision-free configu- 
rations for planar motion of the robotic system FRIEND with 
Y B constant, *F B = 0, and A t = A A = 0. The symbolic inverse 
functions for this case can be found in | 14|. 



of" 4 " f 

* Pitch 



Fig. 11. Grasping objects with three different basic shapes. 




Fig. 12. Free workspace bubbles for a table with shelves. 




the wheelchair and 
der to grasp the ob- 



In this example, the distant 
the table must be not less than : 
ject without a collision. 

I he equations result in eight possible solutions for each 
pair of free workspace bubbles for elbow and wrist joints. One 
out of 8 X (number of bubble pairs) configurations has to be cho- 
sen for the automatic docking task. I his selection can invoke 
different criteria, such .is the maximum distance of robot links 
to obstacles and maximum mampulability. Due to the use of 
the closed solution in Eq. (5), the configuration generation 
and optimization processes can be conducted in parallel. This 
the real-time capacity of the proposed method. 



Experiences and Future Development 

After a short time of training the user is able to grip different 



n object, and the 
r from a bottle 



kinds of objects 

of these manipulation actions are verv labono 
act positioning, as they are needed to grasp a 
execution of a complex task, like pouring wat 
into a glass, are hard to handle. The reasons ai 
the speech recognition system and the tremendous a 
elementary commands that are needed to realize a complex 
task. Particularly, the last point isn't justifiable because of the 
long command sentences that had been introduced for secu- 
rity reasons. It requires the whole concentration of the user 
and is very tiresome. It is possible to shorten the command 
sentences, but in practice in a noisy environment, experience 
showed that these long sentences were necessary. As discussed, 
a marked improvement arises with the introduction of 
semiautonomous actions. In combination with the speech in- 
put system, this provides the user with a set of robust actions, 
which can be combined to accomplish complex tasks. 

In spite of the theoretical and practical results presented 
above, a huge amount of research and development is still re- 
quired. I herefore, future work w ill focus on the analysis and 
implementation of semiautonomous actions, the simplifica- 
tion of the MMI, and improvement of the safety functions. 



Keywords 

Rehabilitation robi 
robots, skill-based 
demonstration. 

References 

[1] B. Borgerding, O. 
"FRIEND - Functi 



introl interface, redundant 
control, programming by 



people,' 



rrtens, N. Ru.hcl. an. 

nConf.fortheAdJancem 
1999, to be published. 



K-e for dis- 



Fig. 13. Configurations without collisions for planar movement of 
the robot system FRIEND. 



)gy, Diisseldorf, Nov. 1 
[2] S. Alfi , O. Ivlev, C. Martens, and A. Graser, "Simulation tool for kine- 

worked industry environment," in^Proc. IECON'99, San Jose, CA, 
USA, Nov. 29 - Dec. 3, 1999. accepted for publication. 

[3] Y.Jiar. M. Wheeler, and K. Ikcuchi. "I land action perception for robot 
programming." m Prec. I '"if, IV.V.V. RSJ Int.Conf.on Intelligent Robots and 
Systems, vol. 3, pp. 1586-1593. 

[4] Y. Kuniyoshr. I. Masavuki, and H. Inoue. "Learning by watching: Reus- 
able task knowledge from visual observation of human performance." 
IEEE Trans. Robot. Automat, vol. 10, pp. 799-822, 1994. 



1 



MARCH 2001 



[5] H. Friedrich, S. Munch, and R. DiUmann, "Robot programming by dem- 
onstration (RPD) : Supporting the induction by human interaction," Ma- 
chine Learning, vol. 23, no. 2-3, pp. 163-89, 1996. 

[6] N. Ruchel, O. Lang, and A. Graser: "Service-robot programming by 
demonstration with sensor integration," m Proc. 1999 IEEE Hong Kong 
Symp. on Robotics and Control, vol. 1, pp. 226-231. 

[7] R. Vogel: "Visuelle Regelung eines Roboters mit sechs Freiheitsgraden 
unter Beriicksi. htigung von < )bjektgr6Be und Objektposition im Bild," 
Universitat Bremen, Diplomarbeil. J uni 1999 (in German). 

[8] NT. Siebel, O. Lang, F. Wirtli. and A. Graser: "Robuste Positionierung 
oil ics Roboters millels Visual Servoing timer Verwenduiig emer 
Trust-Region-Methode," at the Jahrestagung der Deutschen 
Forschungsvereinigung fur MeB-, Regelungs- und Systemtechnik 
(DFMRS), 11-12. November 1999. Bremen (in German). 

|9| M. Jagcrsand: "Visual servoing using Trust Region Methods and estima- 
tion of the full voupled visualm-otor jacobian," in Proc. IASTED Appli- 
cations of Control and Robotics Conf, 1996, pp. 105-108. 

[10] O. Lang, C. Martens, and A. Graser: "Realisation of a semiautonomous 
gripping-skill for the support of disabled people," in Proc. Robotik 2000, 

IECON'99, the 25th Annual Conference of the IEEE Industrial Elec- 
tronics Society, San Jose, CA, Nov. 29 - Dec. 3, 1999. 
[12] T. Trittin and A. Graser: "The method of virtual points for autonomous, 
image-based robot control," presented at 14th World Congress of Inter- 
Preprints vol. B, pp. 293-298. 
^ ofredundantrobots,"i'nProc.3r<i£CPDto. Conf. on Advanced Robots, In- 

[14] O. Ivlev and A. Graser, "Resolving redundancy of series kinematic 
chains through imaginary links," in Proc. CESA'98 IMACS 
.\lniliconL-y;:n.\. ( v//// 1 ;//,?//^;,?/ /ice/iovr/ce m N)'m//o ^/vVoi//eio. 1 unisia. 

1998, pp. 477-482. 

[15] O. Ivlev and A.Graser, "Explicit symbolic solution of the inverse kine- 
matics for redundant robotic systems," at-Automatisierungstechnik, 47, 11, 

1999, pp. 523-531 (in German). 

Christian Martens received his B.S. degree in technical 
computer sciences m 1994 from the 1 'lensburg University ot 
Applied Sciences ,md his M.S. degree in electrical engineering 
from the University of Hagen, Germany, in 2000. During 
1994-1995 he worked for ,i vehicle simulation company as a 
software engineer. Between 1995-2000 he worked as a tech- 
nical assistant at the Institute of Automation, University of 
Bremen. In this position, he has been the technical project 
manager of the rehabilitation robotic system FRIEND for the 
past four years. Currently, he is a Ph.D. student at the IAT 
with research interests in agent-oriented software frameworks 
and intelligent robotic planning systems. 

Oliver Lang received his M.S. degree m electrical engineer- 
ing from the University of Bremen in 1995. During 1995 to 
1999, he was a research assistant at the Institute of Automation 
at the same university. He worked in the field of service ro- 
botics, visual servoing, and zoom camera calibration, and he- 
wrote his doctoral thesis (Ph.D.) about these subjects. During 
1999-2000 he was with the Department of Computer Science 



at the University of Groningen, The Netherlands, as a 
coordinator for industrial automation, where he lectured 
about real-time systems. Since September 2000 he has been 
working as a software engineer in a company that is develop- 
ing coordinate measurement machines. 

Nils Ruchel received his M.S. in electrical engineering from 
the University of Bremen in 1995. From 1995 to 2000 he was 
a research assistant at the Institute of Automation at the same 
university. He worked in the field of new robotic program- 
ming methods (programming by demonstration), where he is 
w riting his Ph.D. thesis. Currently, he is w orking as a project 
manager in a company that is developing fully automated as- 
sembly lines for car motors. 

Oleg Ivlev received his M.S. degree in electrical engineering 
and control science in 1978, and the Ph.D. degree in dynamic 
and control in 1986, both from the State University of 
Dnepropetrovsk, Ukraine, from 1977 he joined the Ukrai- 
nian National Academy of Sciences, where he held several ac- 
ademic and managing positions, conducting research in the 
area of mathematical modeling and control of dynamic sys- 
tems. Concurrently he served as an adjunct professor at the 
State University of Dnepropetrovsk, teaching industrial ro- 
botic systems. During 1995-1997 he was a visiting scientist at 
the Institute of Automation, University of Bremen, Germany. 
Currently, he has been leading the project Kinematic Control of 
Redundant Robotic Systems at the same institute, supported by 
DFG-German Research Foundation. 

Axel Graser is a full professor and head of the Department of 
Process Automation and Robotics at the Institute of Automa- 
tion, University of Bremen. Prior to this position he was a 
professor of automation at the Koblenz University of Applied 
Sciences. He received the B.S. degree in communications en- 
gineering in 1972, the M.S. degree in electrical engineering 
from the Technical University Karlsruhe in 1976, and the 
Ph.D. degree in electrical engineering from the Technical 
University Darmstadt 1982. From 1982 to 1990 he held sev- 
eral industrial positions, heading the development of automa- 
tion systems and real-time software applications for the pulp 
and paper industry as well as the chemical and manufacturing 
industiy. His current research areas are service and rehabilita- 
tion robotics, complete control ot product quality, as well as 
measurement and control technology to automate logistic 
processes. 

Address for Correspondence: Christian Martens, Institute of 

Automation (IAT), University of Bremen, Kufsteiner Str. 
NW 1, 28359 Bremen, Germany. 



MARCH 2001 



